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Abstract 

A notion of detectability for nonlinear systems is discussed. Within the framework of "input 
to state stabihty" (ISS), a dual notion of "output to state stability" (OSS), and a more 
complete detectability notion, "input-output to state stability" (lOSS) have appeared in 
the literature. This note addresses a variant of the lOSS property, using an integral norm 
to measure signals, as opposed to the standard supremum norm that appears in ISS theory. 

Keywords: detectability, zero-detectability, input to state stability, Lyapunov function, input- 
output to state stability, norm observer. 

1 Introduction 

We consider stability features for the system with output: 

x{t) = f{x{t),u(t)), y{t) = h{x{t)), (1) 

where x € R". The function / : x M" is assumed jointly continuous in x and u, 

and locally Lipschitz in x, uniformly in u. The output map h : — > MP is assumed locally 
Lipschitz, and we suppose /(O, 0) = and h{0) = 0. Inputs u(-) take values in some set U C 
(where U = M"* unless otherwise stated). 

The notion of input to state stability (ISS), introduced in |2^, provides a theoretical frame- 
work in which to formulate questions of robustness with respect to inputs (seen as disturbances) 
acting on a system. An ISS system is, roughly, one which has a "finite nonlinear gain" with 
respect to inputs and whose transient behavior can be bounded in terms of the size of the initial 
state; the precise definition is in terms of fC function gains. The theory of ISS systems now 
forms an integral part of several texts ([^, ^, |8|, |2l|) as well as expository and research 

articles (see e.g. [0, ^, 14, 17] as well as the recent 
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Within the framework of ISS, a natural notion of detectability, and a dual to the ISS 
property, is the notion of output to state stability (OSS) addressed in |2j]. These references 
include a characterization of OSS in terms of a Lyapunov (or "storage" ) function, as well as a 
discussion of the roles of OSS and the more general property of input-output to state stability 
(lOSS) in nonlinear observer theory. The lOSS property was further addressed in |]l^] . 

In each of the notions mentioned thus far, signals (i.e. inputs and outputs) are measured 
by a supremum (or L°°) norm. In many cases, it may be more natural to use an integral (or 
L^-type) norm, which corresponds to a measure of the "total energy" of the signal. A variant of 
ISS using this norm, called integral-ISS (iISS) was introduced in ||2^ and further studied in Q. 

This paper addresses a combination of the ideas described above: namely a notion of de- 
tectability making use of integral norms. This property is formulated as a natural combination 
of the loss and iISS properties. It was introduced as integral-input-output to state stability 
(ilOSS) in This notion has been called "integral-detectability" by Morse and Hespanha 
and is closely related to the notion of a "convergent observer" used by Krener in flOfl . In addi- 



tion, all systems which are passive in the sense of [13| automatically satisfy the ilOSS property 
(cf. remark 12 in p^ ). 

The main result in this paper is a characterization of the ilOSS property in terms of the ex- 
istence of an appropriate Lyapunov function. In general, the result provides for the existence of 
a continuous Lyapunov function, though we indicate an important case where the construction 
can be extended to show the existence of a smooth function. Such Lyapunov characterizations 
for detectability notions are especially insightful, since in some cases the notion of detectability 
has been defined in terms of the existence of an appropriate Lyapunov (or "storage") function 

(e.g. 11, m). 

While we refer to lOSS and ilOSS as notions of detectability, they should be called more 
precisely notions of zero- detectability, as they characterize the property that the information 
from the output is sufficient to deduce stability of the state to the origin. For linear systems, such 
a property is equivalent to "full-state detectability" - the property which allows construction 
of an observer which tracks arbitrary trajectories. For nonlinear systems, a zero-detectability 
condition cannot guarantee the existence of a "complete" observer. Given a nonlinear system 
which satisfies a zero-detectability property, the most one may expect is to be able to construct 
a norm-observer which is able to provide a bound on how far the state is from the origin. The 
existence of norm observers for lOSS systems was addressed in |11]. We shall see that a similar 
construction for ilOSS systems follows immediately from the definitions. 



1.1 Basic Definitions and Notation 

The Euclidean norm in a space M'^ is denoted simply by |-|. For each interval T C M and any 
measurable function u : X — M*^, we will use ||n||j to denote the (essential) supremum norm 
of n(-) over Z. That is, \\u\\-j- = ess sup {|ti(t)[ : t G Z}. An input (or control) will be a 
measurable, locally essentially bounded function u : Z ^ M™, where T is a sub interval of M 
which contains the origin, such that u{t) G U C for almost all t ^ Z. Unless otherwise 
specified, we assume Z = M>o. 

For each initial state ^ and input u we let x{t,^,u) denote the unique maximal solution 
of (H), and we write the output signal as y{t, ^, u) := h{x{t, ^, u)). A system is forward complete 
if each ^ G M" and each input u defined on M>o produce a solution x{t,^,u) which is defined 
for all t > 0. 

A function 7 : M>o M>o is of class /C (or a "/C function") if it is continuous, positive 
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definite, and strictly increasing; and is of class fC^o if in addition it is unbounded. A function 
p : M>o IR>o is of class C if it is continuous, decreasing, and tends to zero as its argument 
tends to +00. A function /? : M>o x M>o M>o is of class ICC if for each fixed t > 0, /?(•, t) is 
of class /C and for each fixed s > 0, •) is of class C 

To formulate the statement that a nonsmooth function decreases in an appropriate manner, 
we will make use of the notion of the viscosity subgradient (cf. 



Definition 1.1 A vector € M" is a viscosity subgradient of the function V : ^ M at 

9{h) 

\h\ 



^ € M" if there exists a function g : — > R satisfying lim/^^o = and a neighbourhood 



O C M" of the origin so that 

ViC + h)-ViO-C-h>gih) 
for ah heO. □ 

The (possibly empty) set of viscosity subgradients of y at is called the viscosity subdifferential 
and is denoted di:)V{5,). We remark that if V is differentiable at ^, then di:)V{5,) = {Vy(^)}. 

2 The integral-Input- Output to State Stability Property 

The main property of interest in this paper is the following. 

Definition 2.1 We say that a forward complete system (|l]) satisfies the integral-input- output 
to state stability property (ilOSS) if there exist a G /Coo, /? S K,C, and 71, 72 G /C so that for 
every initial point ^ G M", and every input n, 

a{\x{t,i,u)\)<m\,t)+ [\ii\yis,C,u)\) + -/2{\u{s)\)ds (2) 



JO 

for ah t > 0. □ 
Remark 2.2 We note that, by causality, the ilOSS bound (|2|) can be expressed equivalently as 

rt poo 

a(|x(t,e,n)|) </?(|C|,t)+ / 7i(|y(s,e,n)|)ds+ / j2i\uis)\) ds (3) 

JO JO 

for all t >0. We will make use of this alternate description. □ 



Remark 2.3 Recall that a forward complete system (^) satisfies the input- output to state 
stability property (lOSS) if there exist /3 G )CC, and 71, 72 G /C so that for every initial point 
^ G M", and every input n, 

\x{t,tu)\ < ,t) + 7i(lly(-,e,^^)ll[o,t]) + 72(||^^||[o,t]) 

for ah t > 0. 

It is natural to compare the notion of ilOSS to this analogous property. We will show as a 
consequence of our main result that an lOSS system is in particular an ilOSS system. It has 
been shown (in |11] and [|l[ respectively), that the iOSS property is strictly weaker than OSS, 



and that the iISS property is strictly weaker than ISS. Either of these results show that ilOSS 
is a strictly weaker property than IOSS. □ 
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Remark 2.4 It is an easy exercise to show that for hnear systems the ilOSS property is 
equivalent to detectabihty. However, as mentioned above, for general systems as in (|^), ilOSS 
is a notion of zero-detectability. Given that a system satisfies the ilOSS property, one cannot 
hope to build a complete observer for the system, but rather only a norm observer which 
measures how far the state is from the origin. The construction of norm observers for lOSS 



systems was addressed in [11|, where it was shown that a system satisfies the lOSS property if 
and only if it admits an appropriate norm observer. 

For ilOSS systems, the situation is more transparent. It is immediate that if a system 
satisfies the ilOSS bound (||), then for the function p : M>o —<■ M>o defined by 

pit) = iii\yit,tu)\) + 72iHt)\), Pio) = o, 

the system will satisfy 

a{\x{t,^,u)\)<m\,t)+p{t) Vt >0. 

Thus the function p(-) provides an asymptotic upper bound for the size of the state, i.e. it is a 
norm observer for the system. 

To extend these ideas to the case where construction of a full-state observer may be possible, 
one must consider a notion of "complete" detectabihty for nonlinear systems. Such a notion 



was introduced in |24] under the name of incremental-IOSS. □ 



2.1 ilOSS Lyapunov Functions 

Definition 2.5 We call a continuous function V : M" lR>o an ilOSS Lyapunov function if 
there exist a,a£ ICoo, o"2 G /C, and k : M>o — > IR>o continuous positive definite so that 

am<V{0<am V^GM" (4) 

and 

C • f{^,l^) < + MlKOl) + ^2(|/i|) G M", V/i G M'" (5) 

for each C G doViO- □ 

We remark that the decrease statement can be written equivalently in an integral for- 
mulation, using the following standard result. 

Proposition 2.6 (e.g. [^] Proposition 14) Given a forward complete system as in (0), a con- 
tinuous function V : M" — s- M>o, and a continuous function w : M" x M™ M, the following are 
equivalent: 

1. For all ^ G M" and all /i G M™ 

for each C G doViO- 

2. For each ^ G M" and each input u, the solution u) satisfies 

V{x{t,^,u))-V{0< f w{x{s,^,u),u{s))ds 

for any t > 0. 
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□ 



Remark 2.7 Applying Proposition |2.6| with 

we conclude that the decrease statement (|5|) in the definition of an ilOSS Lyapunov function 
could be equivalently written as 

V{x{t, e, u)) - V{0 < f e, n)|) + ai{\h{x{s, u))\) + a2{\u{s)\) ds (6) 

for all € M", all inputs n, and all t > 0. This alternative formulation will be used below. □ 

3 Lyapunov Characterization 

Our main result is the following 

Theorem 1 Suppose system (|^ is forward complete. The following are equivalent. 

1. The system is ilOSS. 

2. The system admits an ilOSS Lyapunov function. 

Remark 3.1 The main result in is a Lyapunov characterization of the lOSS property. It 
is shown in that reference that a system is lOSS if and only if it admits an lOSS Lyapunov 
function, which can be defined as an ilOSS Lyapunov function for which the function k is of 
class /Coo- Thus it is an immediate consequence of Theorem |l] that the lOSS property implies 
the ilOSS property. □ 

Remark 3.2 We will prove a slightly stronger statement than (2 =^ 1) of Theorem |l|. The proof 
below shows that the existence of a lower semicontinuous ilOSS Lyapunov function implies that 
a system is ilOSS. □ 

It is still an open question whether every ilOSS system admits a smooth ilOSS Lyapunov 
function. However, as a minor extension of the proof of Theorem |I] we will also show the 
following. 

Lemma 3.3 Suppose system (|l|) is forward complete and has compact input value set U. Then, 
if the system is ilOSS, it admits a smooth ilOSS Lyapunov function, i.e. there exists a smooth 
(C°°) function y : M" — > ]R>o, and a, a £ /Coo, fi, o"2 € /C, and k : M>o M>o continuous 
positive definite so that @ holds and 

vF(o • fit /") < -<m + Mm)\) + ^2(1/^1) ve g r^, g u. 

Remark 3.4 Lemma |3.3| provides, in particular, a Lyapunov characterization in terms of a 
smooth function for the property of integral- output to state stability (iOSS) which is defined as 
ilOSS for systems with no inputs (or equivalently, with U = {0}). □ 
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3.1 Sufficiency 

We begin with the proof of (2 ^ 1) (sufficiency) in Theorem ||. Here we follow the sufficiency 
argument given in [|^]. A few preliminary lemmas are needed. 

Lemma 3.5 (Q Lemma 4.1) Let k : M>o — > M>o be a continuous positive definite function. 
Then there exists pi € /Cqo and P2 ^ ^ such that 

k(s) > pi(s)p2(s) Vs>0. 

□ 

The following comparison result will be needed. This is a generalization of Corollary 4.3 
ini. 

Proposition 3.6 Given any continuous positive definite a : M>o — > M>o, there exists a ICC 
function f3 with the following property. For any < t < oo, any lower semicontinuous function 
y : [0,t) — 5- M>o, and any measurable, locally essentially bounded function v : [0,t) ^ IR>o, if 

y{t2) < y{ti) + f ' -a{y{s)) + v{s) ds VO < ti < < ^ (7) 



then 



y{t) < P{y{0),t) + [ 2v{s) ds Vt G [0, t ). 
Jo 



□ 



The following lemma will be needed to prove Proposition 3.6 



Lemma 3.7 Suppose given a locally Lipschitz positive definite function a : M>o — > M>o, a 
time < t < oo, and a measurable, locally essentially bounded function v : [0,t) ^ ^>o- Let 
y : [0,t) ^ ]R>o be any lower semicontinuous function which satisfies (0). Define w{-) to be the 
solution of the initial value problem 

w{t) = -a{w{t)) +v{t), w{0)=y{0). (8) 

Then w{t) is defined for all t € [0, t ) and 

y{t)<w{t) yte[o,t). 

Proof. (We follow the proof of Theorem in.4.1 in Q). Let y(-) and w{-) be as above for given 
a, t, and v{-). We first note that w{-) exists for all t € [0, t ), since a is nonnegative and f (■) is 
essentially bounded on each finite interval. For each integer n > 1, let Wn{-) be the solution of 

Wn{t) = -a{Wn{t)) + V{t) + Wn{0) = y{0), (9) 

n 

which is also defined on [0, t ). We will show that 

y{t)<wn{t) VtG[0,O (10) 
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for all n > 1. Indeed, suppose not. Then there exists n > 1 and r G [0,t) so that 

j/(t) > Wnir). 

Let 

to := sup{t G [0,r] : y{t) < Wnit)}. 
Then, as y{-) is lower semicontinuous and Wn{-) is continuous, 

y{to) < Wn{to). 

We claim that in fact y(to) = Wn{tQ). If this were not the case, there would be numbers 6i, 62 
so that 

y{to) <6i<62< Wn{to). (11) 

From (^), we have that 

rto+t 

y{to + t)< y{to) + / -a{y{s)) + v{s) ds 

Jto 

for each t G [0, t — to)- Since 

rto+t 



rto+t 

lim / —a{y{s)) + v{s)ds = 0, 

Jtn 



'to 

it follows from (|ll|) that there is some ei > so that y{to + t) < 61 for all t G [0, ei]. Since 
Wn{-) is continuous, ( pT[) also gives an £2 > so that Wn(to + t) > (^2 for all t G [0,62]- Thus 
y{to + t) < Wn{tQ + t) for all t sufficiently small, which contradicts the definition of to- We 
conclude that y(to) = Wn(to)- 

From (0) and Taylor's Theorem, we have that for e G [0,t — to), 

j-to+e 

y{to + e) < ?/(to) + / -a{y{s)) + v{s) ds 

Jto 

= yito) - £a{y{to)) + ev{to) + o{e) 

and from (P) 

rto+e 

Wnito + e) = Wnito) + -a{Wnis)) + v{s) + - ds 

Jto ri 

= Wn{to) - ea{wnito)) + ev{to) -\ ho(e), 

n 

where o(-) signifies a function satisfying limj„>o ^ = 0. Since ?i;n(to) = yiio), it follows that 
y(to + e) < Wn{to + e) for e sufficiently small, a contradiction. Thus (|l^) holds for all n > 1. 

We note that Wn{t) — > w{t) uniformly on each finite time interval (cf. e.g. Theorem 1 in [p5| ). 
Thus for any T G [0, t ), as ( |To|) holds for all n, 

y{t) < lim Wn{t) = w{t) Vt G [0,r]. 

n— >oo 

As T > is arbitrary, we conclude that y{t) < w{t) for all t G [0, t ). I 
To complete the proof of Proposition we will also need the following statement. 
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Lemma 3.8 (Q Corollary 4.3) Given any continuous positive definite a : M>o — > M>o, there 
exists a ICC function /? with the following property. For any < t < oo, any absolutely 
continuous function tt; : [0, t ) — > M>o, and any measurable, locally essentially bounded function 
u : [0,0 ^M>o, if 

w{t) < -a{w{t)) +v{t) (12) 

for almost all t € [0, i ), then 

w{t) < /3{w{0),t) + [ 2v(s) ds yte[0,t). 
Jo 

□ 



The proof of Proposition 3.6 is a straightforward combination of Lemma 3.7 and Lemma 
Proof. (Proposition 3^) Let a continuous positive definite a : M>o K>o be given. Without 
loss of generality, we assume a is locally Lipschitz (otherwise we replace a by a locally Lipschitz 
function majorized by a). Let (3 be the JC£ function given by Lemma |3l8|. Suppose t, y{-) and 
v{-) are as in the statement of the Proposition so that ^ holds. Let w{-) be the solution of the 
initial value problem (Mj . Then Lemma |3.7| gives 



y{t)<w{t) \/te[o,t). 
Also, since w(-) satisfies (as an equality). Lemma |3^ gives 



w{t) < P{w{0),t) + 2v{s)ds yte[0,t). 



Since w(0) = y(0), the result follows. I 

We can now give the argument for sufficiency of the Lyapunov characterization. As men- 
tioned earlier, this proof holds for lower semicontinuous Lyapunov functions. 
Proof. Theorem |l] (2 ^ 1) 

Suppose the function V satisfies the definition of an ilOSS Lyapunov function for the forward 
complete system (||) with functions a, a, k, ai and (T2 satisfying (§) and (^. Let pi € /Coo and 
/92 € £ be functions as in Lemma |3.5| for k. Let 



p{s) ■= pi{a ^{s))p2{a ^(s)). 
By (Q) and (^, we have, for each ^ € and each input u, 



t2 



Vix{t2,tu)) < Vixih,C,u))+ / -K{\x{s,tu)\) + aii\h{xis,^,u))\) + a2{\uis)\) ds 



< V{x{h,C,u)) + 

< V{x{h,C,u)) + 
for all < ti < t2- 



t2 



t2 



-Pl{\xis,tu)\)p2{\x{s,C,u)\) 

+ ai{\h{x{s,C,u))\) + a2{\u{s)\) ds 
-p{V{x{s,C,u))) + ai{\h{x{s,C,u))\) + a2{\u{s)\) ds 
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Then, as p is continuous positive definite, Proposition 3^ gives the existence of a KC 
function (3 so that for each ^ E M" and each input u 

M\x{t,i,u)\) < V{x{t,i,u)) < P{V{0,t)+ [ 2ai{\h{x{s,^,um + 2a2{\u{s)\)ds 

Jo 

< P{am,t)+ [ 2ai{\hix{s,tu))\) + 2a2{Hs)\)ds 







for all t >0, which is the required bound. 



3.2 Necessity 



We next prove (1 =^ 2) (necessity) for Theorem ||. We will construct an ilOSS Lyapunov 
function for a given ilOSS system. The proof combines ideas from the constructions in 
and Q. The following result will be needed. 

This statement follows directly from Proposition 7 in p^. 



Proposition 3.9 For any given fCC function f3, there exist a family of mappings {Tr}r>o with: 

• for each fixed r > 0, : M>o R^g is strictly decreasing; 

• for each fixed e > 0, Tr{e) is strictly increasing as r increases and limr^oo ^^.(e) = oo; 

• the map (r, e) i— > Tr{e) is jointly continuous in r and e; 
such that 

P{s,t)<e 

for all s < r, alH > Trie). □ 

Before giving the construction, we will cite a lemma on boundedness of reachable sets for 
forward complete systems which says that the reachable set from a given point over a finite 
time interval [0, T] is bounded if the inputs are required to satisfy a bound of the type 

T 

'J {\u{s)\) ds < M < OO (13) 







for an appropriate choice of 7 € /Coo- 

Remark 3.10 Note that for arbitrary /Coo functions 7, this need not hold. Take, for example 
the one-dimensional system x = u'^. With 7(5) = s, the inputs 



Uk{t) 



k <t< I 
I <t< 1 



defined on [0,1] satisfy j{\uk{s)\) ds = 1 for each k > 1. However, the solution starting at 
the origin corresponding to the input lifc(-) satisfies x(l) = k, and so clearly one can reach an 
unbounded set in one time unit using controls satisfying ([l^). □ 



The following lemma shows that one can always choose 7 so that the bound (^) on inputs 
implies a bounded reachable set. (In the example above, clearly 7(5) = will do.) 
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Lemma 3.11 (|2| Corollary 2.13) Suppose system (|^) is forward complete. Then there exist 
functions xi, X2, X3j of class /Coo and a constant c > such that 

\x{t,^,u)\ < Xi{t) + X2m) + X3 a{\u(s)\)ds^ +c 
holds for all G M", all inputs u, and alH > 0. □ 

We now provide the Lyapunov construction. 
Proof. Theorem |l] (1 =^ 2) 

Suppose the system (||) is forward complete and satisfies the ilOSS property with gains a, f3, 
71 and 72. 

Pick any smooth, strictly increasing and bounded function /c : M ^ M>o whose derivative is 
strictly decreasing. Then there are two positive numbers ci < C2 so that k{t) G [ci,C2] for all 
t > 0. Define X{t) : R>o M>o by 

AW := ^m. 



Since the system is forward complete, we may find a function a G /Coo as in Lemma 3.11 



Define 72(5) := max{72(s), cj(s)} for all s > 0. Note that the ilOSS bound (g) holds with 72 in 
the place of 72. 

We define a Lyapunov function as 

rt /-oo \ 

7ii\y{s,^,u)\)ds- / 2^2i\u{s)\)ds]k{t) 



Vb(0 := supsup H a(|x(t,C,M)|) - / 

u t>0 I V JO 



for each ^ G M". It is immediate that this function satisfies (|^, as 

cia(lCl) < VoiO < C2/?(|el ,0) G M". (14) 

The first of these inequalities follows from considering the trajectory with input u = at time 
t = 0, and the second from the ilOSS bound (|^: for any ^ G M" and any input u, 

a{\x{t,i,u)\) - ji{\yis,^,u)\)ds- 2j2{\uis)\) ds 
Jo Jo 

ft fOQ 

< a{\x{t,^,u)\) - 'yi{\y{s,^,u)\)ds - j2{\u{s)\) ds 

Jo Jo 

< I3m,t) (15) 

< /?(iei,o) 

for ah t > 0. 

Next, we observe that for each ^, the supremum over inputs in Vo(C) can be taken to be a 
supremum over a restricted set, as follows. From the ilOSS bound (^, we have, for any ^ G M" 
and any input u, 

ft fOC 

a(|x(t,C,n)|) </3(|e|,0)+ / li{\y{s,^,u)\) ds + ^2{Hs)\)ds 

Jo Jo 

for all t >0. Suppose now that ^ and u are such that 

> 

j2iHs)\)ds> Pi\C\,0). 
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In this case it follows that 



a(|x(t,e,n)|) < / ^^{\y{s,i,u)\)ds+ 2'^2{Hs)\) ds 
Jo Jo 



for alH > 0. Then for alH > 

rt 



a(|x(t,e,n)|) - / ^ii\yis,tu)\)ds- 2^2i\u{s)\) ds < 0. 
Jo Jo 

Since Vo(6 > for each ^ € M", it follows that for each ^ e 

^0(0= sup sup|fa(|x(t,e,n)|)- / ^i{\y{s,^,u)\) ds - [ 2j2{\n{s)\) ds) k{t)] . 
u£U{\^\) t>o L V Jo Jo J ) 

where, for each r > 0, we define U{r) := {u{-) : j2i\u{s)\) ds < /?(r, 0)}. 

We next make the observation that the supremum in time can be taken over a restricted 
set as well. Let Tr{e) be defined as in Proposition 3^ for the function (3. From (|l^ and (15) 
we have 



{\x{t, ^, u)\) - jiMs, e, u)\) ds - 1^ 272(k(s)|) ds^ k{t)^ , 



^oiO = sup sup < ( a 

u&U{\i\)0<t<T^ [ 

where for each ^ G M" we set := Tsi^i (^a(^)). 

We will show that the function Vq is continuous on M" by showing lower and upper semi- 
continuity in the next two lemmas. 

Proposition 3.12 The function Vq is lower semicontinuous on M". 
Proof. We will show 

hminf yo(^) >yo(^o) 

for all Co e R". 

Fix Co £ I^" Sund let e > be given. There exists an input uq and a time to ^ so that 



a{\x{to,^o,uo)\) - [ 'yi{\y{s,^o,uo)\)ds - [ 272([no(s)|) ds^j fc(to) > Vo(Co) - |- 



rk) 

10 JO 

By continuity of x(to, -,^0) and a, there exists a neighbourhood Ui of Co so that 

e 



|a(|2;(to,Co,^^o)|) - a{\x{to,(.,uo)\)\ < 



0) 



for all C £ Ui. Furthermore, as C — > Co implies y(t,(,,uo) converges uniformly to Coi^^o) on 
the finite interval [0,^0]; and since 71 is uniformly continuous on a compact containing an open 
neighbourhood of Coj^^o) : t € [0,to]}; we can find a neighbourhood U2 ^ Ui of Co so that 
each C £ satisfies 

l7i(|y('S,Co,^^o)l) -7i(|y(s,C,^^o)l)l < w, s 

Atok{to) 
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for all s € [0, to]- Then for each £ U2, 

a{\x{to,^o,uo)\) - J Ji{\y{s,^o,uo)\) ds^ - (^a{\x{to,^,uo)\) - J 7i(|y(s, ^, uo)|) 
- Ai u \ + I bi{\y{s,iQ,uo)\) --ii(\y{s,i,uo)\)\ ds 



< 



^Hto) Jo 

e 



2k{to) 

This gives, for each G U2, 

VoiO > (^a{\x{to,^,uo)\)- ^i{\y{s,^,uo)\)ds- 2j2 (Wo {s)\) ds^ k (to) 

> (^a{\x{to,^o,uo)\) - li{\y{s,^o,uo)\) ds - 2j2{\uo{s)\) ds^ k{to) - ^ 

Hence Vq is lower semicontinuous. I 
The next result will be needed to show upper semicontinuity. 

Proposition 3.13 For each T > and each compact C C M"', there exists Lc,t > so that 
for any input u € U{C) := U^ec ^(I'^l)' each pair r], ( G C has the property that 

\x{t,ri,u) - x{t,C,u)\ < Lc,t\v - C\ Vt G [0,r]. 
That is, the trajectories are Lipschitz in the initial conditions, uniformly over inputs u G U{C). 



Proof. From Lemma 3.11, we have that the trajectories stay in a bounded set on the interval 
[0,T]. A standard Gronwall's Lemma argument gives this Lipschitz condition from the local 
Lipschitz assumption on /. I 

Proposition 3.14 The function Vq is upper semicontinuous on M". 
Proof. We will show 

hmsup yo(^) < yo(^o) (16) 

for ah ^0 G K"- 

Suppose (16) fails at some ^0 £ I^"- Then there exists e > and a sequence {S,j}JLi so that 



Co and 

Vo{ij) > Voiio) + e (17) 
for all j > 1. Choose r > so that <r and j^jl < r for all j > 1. Then for each j > 1, 



V{Cj) = sup max I (a{\x{t,^j,u)\) -[ ' 



I'OO 

li{\y{s,i,,u)\)ds- / 2-^2{\u{s)\)ds]k{t) 
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where Tq := Tr(^(Vb(^o) + Now, for each j > 1, there exists tj E [0,To], Uj £ U{r) for 
which 

ai\xiTj,^j,Uj)\) - -fi{\y{s,^j,Uj)\)ds - 2'^2{\uj{s)\) ds^ k{Tj) > Vo{^j) - |. 

Let R be the reachable set from Br ■= {£, G M" : |^| < r} in time less than or equal to Tq with 
controls in U{r). Then Lemma 3.11 tells us that R is bounded. From Proposition 3.13| and the 
fact that the output map h is locally Lipschitz, we can find Lx > and Lj, > so that 

\x{t,7],u) - x{t,C,u)\ < L^. |r/-C| 
\y{t,rj,u) -y{t,C,u)\ < Ly\rj-C\ 

for all t G [0,To], for any pair rj, ( £ Br and for any input u G U{r). Further, since a is 
continuous, it is uniformly continuous on the bounded set R, so there is a f^^; > so that 

|Ci-C2|<<5. ^|a(Ci)-a(C2)|< ^ 



if Ci, C,2 G R. Likewise, since 71 is uniformly continuous on the bounded set h{R) := {h{r]) : 
7] £ R}, there is a (5y > so that 

\m - m\ <^y=> l7i(^?i) - < 



for 7?2 G h{R). Then, for each j large enough so that — ^o| ^ max{L L } ' ^'^'^ 
<^{\x{Tj,Cj,Uj)\) - j ji{\y{s,Cj,Uj)\)ds^ - (^a{\x{Tj,(,o,Uj)\) - j ji{\y{s,^o,Uj)\) ds 



e 



2k{To)' 

From which we find, for each j sufficiently large, 



Vb(^o) > (^a{\x{Tj,^o,Uj)\) - li{\y{s,^o,Uj)\)ds - 2j2{\uj{s)\) ds^ k{Tj) 



£ 



> \^a{\x{Tj,(,j,Uj)\) - ji{\y{s,(,j,Uj)\)ds - 2'y2i\uj{s)\) ds j k{Tj) - - 

which contradicts (p^). We conclude that Vq is upper semicontinuous. I 

Finally, we show that the function Vq satisfies the decrease statement (^). Let G M"\{0} 
and an input v be given, and consider the resulting trajectory. For r > small enough, we have 

< \x{t, £,,v)\ < 2 1^1, so for such r the supremum over time in the expression for Vo{x{t, ^, v)) 
may be taken over [0,rg]. We find, for such r sufficiently small, 

Vo{x{t,^,v)) 

= sup sup \ [a{\x{s,x{T,^,v),u)\) - -fi{\y{r,x{T,(,,v),u)\) dr 
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272(|n(r)|)dr ) k{s) 
sup sup \(a{\x{t,^,v^ru)\)- -fi{\y{r,^,v^ru)\)dr 

U T<t<T+T(_ L \ Jt 

- J^2j2{HMr)\)dr^ k{t-T) 



< sup sup i [a{\x{t,^,v^ru)\) - ji{\y{r,^,v^ru)\)dr + ji{\y{r,^,v'^ru)\) dr 
u 0<t<T+T{ L \ Jo Jo 



f 

Jo 



< sup sup <^ [ a[\x 

u 0<t<T+T{ 



2^2{Hru{r)\)dr + 2%{\v^ru{r)\) dr ] k{t - t) 
rt 



{t,^,v^ru)\) - f li{\y{r,^,viru)\)dr 
Jo 

2^2{HMr)\)dr^k{t-T)^ +C2 ji{\y{r,^,v)\) + 2j2{\vir)\) dr 
< sup sup I (a{\x{t,(,,v\\ru)\) - 'yi{\y{r,(,,v^ru)\)dr 

u 0<t<T+Tf I, \ Jo 



f-OO 

■ / 2%{\v^ru{r 
Jo 



r)\) dr I k{t) > • max 



k{t - r) 



0<t<T+Tf k{t) 

+ C2 [ ji{\y{r,^,v)\) + 2%{\v{r)\) dr 
Jo 

< supsup I ( ai\x{t,^,u)\) - f jMr,^,u)\)dr- f 2j2i\u{r)\) dr] kit) 

u 0<t l\ Jo Jo J 

o^iAT}\-^Y''l^'^\^^^^^^^^ 



where v\tU is the concatenation of u with v at time r, that is 

v{t) if < i < r 



- r) if T < t 



Rewriting, we arrive at 

Vo{x{T,i,v)) -Vo{i) 

< VoiO- max -1 + 

0<t<T+T^ [ 



k{t - t) 
~fc(t)" 



+ C2 / 7i(|y(r-,?,^^)|) + 272(|^^(r)|)dr 
Jo 



for r > sufficiently smah. Recah that \{t) = ^k{t) is decreasing, so for r > smah enough. 



max 

0<*<T+Tj 



-1 + 



kjt - r) 
~fc(irj 



< — min 

0<t<T+T^ 



k{t) - k{t - t) 



C2 



KTi + r)-k{T^) 



C2 
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So for r > sufficiently small, 

Vo{x{t,^,v))-Vo{0 < -Vo{o'^^^^^^^^^^-^ + C2 [\i{\yir,C,v)\) + 2^2iHr)\)d^ 

_M) A(rg + r) + C2[7i(|y(r, tv)\) + 272(k(r)|)] dr. (18) 

Recall that ( [l8| ) has been verified for all ^ ^ 0. We next note that it also holds for ^ = 0. 
Let an input v be given. The calculation above (with = oo) gives, for r > 0, 

Vo{x{t,0,v)) < yo(0) -sup P^^'^H +C2 / Ji{\y{r,^,v)\) + 2j2{\v{r)\) dr 



k{t) 



C2 / li{\y {r, t +'^l2i\v {r)\) dr, 



as Vb(0) = 0. Clearly this gives (|T|) for ^ = 0. 

Finally, we will make use of the following lemma to formulate the decrease statement ( p!8| ) 
in the viscosity sense. 

Lemma 3.15 Suppose given a system as in (^, a function V : ^ M, a point ^ S M", and 

an element fi E M™. Then, if there exists a continuous a^^u ^ IR>o ~^ ^ e > so that for all 
< T < e 

V{x{t, e, u)) - V{0 < r a5,u(r) dr (19) 

JO 

where u is the input constantly equal to fi, then for any G doViC), the instantaneous form 
of (|ig|) holds in the viscosity sense: 

c-/(e,/^) <ae,u(0). 

Proof. Suppose V, ^, 

/^) '^5,u snd £ are as above, and suppose (£ djjVi^^^). Then, from the 
definition of the viscosity subgradient, we know that for r small enough 



r 0^,^(0 dr > V{x{t, u)) - V{0 > C • (x(r, u) - + ff(x(T, u) - 

JO 



(20) 



where g is some function satisfying lim^^o = 0. We note that since u is constant val- 
ued, the trajectory x(-,^, u) is differentiable (not merely absolutely continuous). In particular. 



^x(t,C,u)|f=o = /(?,At)- Now, dividing by r in (||) gives 

Ioa^,u{^)dr x(T,g,u)-g ^ g(x(r, u) - g) 

T ~ T T 

Taking the limit as r tends to 0, we find 

g(x(r,^,u) - 



a^,u(0) > C-/(e,/«) + lim 



T^o r 

2;(t", u) - ^1 g(x(r, ^, u) - 



r^o T |j;(t,^,u) - ^1 

A f^c \ I f/^c M r 5(2;(^,C,u) -^) 
C-/(C,^) + l/(e,/^)l lim 

C-/(C,/x). 
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Applying Lemma 3.15| to (|T8|) with 

«C,u(r) = -^Xm + r) + C2[7i(|y(r, e,u)|) + 272(|u(r)|)] 

C2 

we conclude that 

<^./(^,^)<_M)M) +C2^^(|/,(^)|) + 2c272(|/i|) V^GM", V^GM'" 

C2 

for each C G 5i5Vb(^). This implies (|5|), since Vo(-)A(T(.)) : M" ^ M>o is continuous positive 
definite, so we can choose a continuous positive definite function k : M>o M>o so that 
k(ICI) < ^Voi^Xm) for each ^ G M". Then 

C-/(e,/^) < -'^(l^l)+C27i(|/i(e)l)+2c272(I/i|) VCGM", /xGM™ 
for each ( G (?£)Vb(^). 

This completes the construction of the ilOSS Lyapunov function. I 

Finally, we prove Lemma by extending the proof in the case where the input value set 
U is compact. 
Proof. (Lemma |3.3| ) 

Suppose the forward complete system (||) satisfies the ilOSS property and has compact 
input value set U. Given the construction above, it follows from Corollary 4.22 in |l^] that 
there exists a smooth function V : M"\{0} — > ]R>o, for which 

^<V{0<2Vo{0 VeGR"\{0} (21) 

and 

Vi^(0 • /(e,/^) < -^/^del) + C27i(l^(C)l) + 2c272(|/^I) G R"\{0}, V/i G U. (22) 

We extend V to M" by setting V{0) = 0. It is immediate that the resulting function is continuous 
on and that (|2ll) holds on all of M". 



By Proposition 4.2 in [15| there is a smooth p G /Coo with p'{s) > for all s > such that 
p oV is smooth everywhere. Without loss of generality, we may assume that p'{s) < 1 for all 
s > 0. (If it is not, we may replace p by a smooth /Coo function pQ with the property that 
Pq(s) = p'{s) in a neighbourhood of the origin where p'{s) < 1 and Po(s) < 1 everywhere else.) 
LetV = poV. It follows from (|l|) and (0) that 

a(|C|)<y(0<«(iei) VeGM", 

where a{s) = p{^-a{s)) and a{s) = p{2c2P{s, 0)). Let kq : M>o M>o be a continuous positive 
definite function which satisfies ko(|^|) ^ p' {V{^))^k{\£,\) for all ^ G M". From (p2|), we have 

VF(e) • /(e, /x) < -p'{V{0)l<m + P'(^^(0)(c27i(|/i(6l) + 2C272(|/^|)) 

< -^o(|el)+C27i(|/i(e)l) + 2c272(|;u|) G M", G U. 

This holds at ^ = since V is smooth and has a minimum at the origin, so W{0) = 0. Thus 
y is a smooth ilOSS Lyapunov function for the system. I 
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